Maxwell's Demon Assisted Thermodynamic Cycle in Superconducting Quantum 

Circuits 
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We study a new quantum heat engine (QHE), which is assisted by a Maxwell's demon. The QHE 
requires three steps: thermalization, quantum measurement, and quantum feedback controlled by 
the Maxwell demon. We derive the positive-work condition and operation efïïciency of this composite 
QHE. Using controllable superconducting quantum circuits as an example, we show how to construct 
our QHE. The essential role of the demon is explicitly demonstrated in this macroscopic QHE. 

PACS numbers: 05.30.-d, 03.67.-a, 85.25.Cp 



Introduction. — A Maxwell demon is a construct that 
can distinguish the velocities of individual gas molècules 
and then separate hot and cold molècules into two do- 
mains of a container, so that the two domains will have 
different temperatures 0. This result seems to contra- 
dict the second law of thermodynamics, because one can 
put a heat engine between them to extract work. The so- 
lution of thispuzzle refers to the so-called Landauer's 
principle 0, IÜ that essentially links information theory 
with fundamental physics 0. Several quantum heat en- 
gines (QHEs) assisted by Maxwell's demons have been 
proposed in Refs. yjL·aL·l· 

Here, we propose a new QHE model integrated with a 
built-in quantum Maxwell's demon performing both: the 
quantum measurement on the working substance, and 
the feedback control for the system according to the mea- 
surement. We demonstrate the role of Maxwell's demon 
in a fully quantum manner. The thermodynamic cycle in 
our setup contains three fundamental stages: (i) a CNOT 
operation, making a pre-measurement to extract infor- 
mation from the working substance; (ii) the feedback- 
action of the demon controlling the working substance to 
extract work; and (iii) the disentanglement process that 
thermalizes the working substance and the demon by two 
separate thermal baths. The demon plays a role in the 
first two steps. 

We further illustrate how to implement our QHE us- 
ing superconducting qubit circuits làlSl- In °ur setup, 
the demon-assisted working substance does work via two 
CNOT operations, which can be realized by single-qubit 
operations and an easily realized i-SWAP operation. The 
CNOT operation performs the bàsic functions of the 
quantum demon. 

Maxwell's demon-assisted thermodynamic cycle in two- 
qubit system. — Our QHE cycle is similar to a quantum 
Otto cycle [ïoj described in Ref. 01 and generalized in 
Ref. [12|. Here, the QHE, shown in Fig.^ is a compos- 
ite system consisting of two qubits: the "working sub- 
stance" S and the quantum Maxwell's demon D. They 
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FIG. 1: (color online). Schematics of the Maxwell's-demon- 
based quantum heat engine (QHE). The qubit S is the "work- 
ing substance" system, which is monitored and then con- 
trolled by another qubit D, acting as a Maxwell's demon. 
The central circle with the letter "c" denotes a switchable 
coupling between the S and the D. S plus D form the QHE. 
Qin and Q ou t indicate the heat absorbed and released; W de- 
notes the work done. When the erasure of D is included in 
the cycle, according to Landauer's principle, the violation of 
the Second Law is prevented. 



are separately coupled to two different heat baths with 
the temperatures Ts and Tr>. Using the Pauli matrices 
0of ^ (F — S , D; a = x, y, z), the model Hamiltonian can 
be written as 



H, 



(F) 



(S) a (D) 
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where Àf is the level spacing of the qubits and Et, is a 
controllable coupling strength between S and D. Using 
both the controllable XY interaction and on-site poten- 
tials in Eq. we can realize various quantum lògic 
operations ■ Now, let us study each step of our QHE 
cycle and calculate the work done and the heat absorbed 
in each step of the thermodynamic cycle. 

SI: S and D are decoupled by setting El = 
in Eq. and separately coupled to two heat baths 
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with different temperatures T$ and Tu- As shown be- 
low, whatever are the initial states of S and D, ei- 
ther entangled or separated, after a thcrmalization, they 
will reach their respective equilibrium states: /0 F (1) = 
p F (0)|0 F )(0 F | + p F (l)|l F )(l F |, with F = S or D. Here, 
p F (l) = exp(— /3 F A F )/z F , and p F (0) = l/zp, are the 
Boltzmann probability distributions for two energy lev- 
els; zp — 1 + exp(— /3 F A F ) is the partition function with 
f3p = í/QcbTp), where ks is the Boltzmann constant. 
We have chosen the ground state energy as zero. The 
thermalized state p(l) = ps(l) ® Pd(1) of the total sys- 
tem is 

p(l) = p^|l,l)(l,l|+^° D |l,0)(l,0| (2) 
+ ^|0,1)(0,1|+4'° D |Q,0)(0,Q|, 

where for F,F' = S,D and q, q' = 0,1, \q,q') = 
\Qs) <S> \q' D ) and p^ q F , = p F (q) p F > (q') being the joint 
probabilities. 

S2: The second step is a CNOT operation flipping the 
demon states only when the working substance system is 
in its excited state 0. In this step, the demon acquires 
information about the system. This CNOT process can 
be realized 0| by the controllable Hamiltonian Q and 
is assumed to be so short that the coupling of 5* and D 
to the baths can be ignored. Thus, p(l), after the second 
step, is changed to 

p(2) = p^|l,0)(l,0|+p^° D |l,l)(l,l| (3) 
+P5,dI0 ! 1}(0,1|+^° í5 |0,0}(0,0|. 

The entropy of p(2) is equal to that of p(l), i.e., mea- 
surements do not lead to entropy increase [3 IH Ü] This 
agrees well with Landauer's principle. 

S3: In the third step, the demon controls the system 
to do work according to the information acquired by the 
demon about the system. Physically, the system expe- 
riences a conditional evolution (CEV) U c which can be 
realized by the Hamiltonian (Q), that is, \qs) <8> \q' D ) — > 
{Uc) q '\qs) ® \q' D ) and U c \q s ) = \qs). Here, \í s ) = 
cos9\ls) + sin9exp(i(p)\0s), and \Òs) = — siní?|ls) + 
cos 9 exp(i(p) |0s), are the states of the working substance 
after the conditional evolution; 9 and <p are real param- 
eters. A CNOT is a special CEV for 9 = tt/2. After the 
third step, the density matrix p(2) evolves into 

p(3) = pf D |l,0)(l,0|+p^ |ï,l)(ï,l| (4) 

+Ps?d |Ò,1)(Ò,1|+Ps'°d |o,o> (0,0|. 

Finally, the system and the demon are decoupled by 
setting El — in Eq. (JTJ and brought into contact with 
their own baths again, and then a new cycle starts. For 
each cycle described above, we are now able to calcu- 
late the work performed by the heat engine as W = 
- (E% +E'^-E S - E D ) = A s (p$, - p 1 ^ |(ï |1)| 2 - 



Pfo |<Ò \^\ 2 )+^d(p^ d -P^ d ), where E% (E s ) nndE D 
(Ed) are the infernal energies of the system and demon, 
respectively, after the third (first) step. The heat ab- 
sorbed by the system from the heat bath is Q la = Es—Eg 

= Asíp^-Pft |(ï l 1 )! 2 -^ |<0 I 1 )!')- Basedonthe 
above results, the operation efficiency 77 can be given as 

V = W/Qin = 1 - (A D /A S )Ç (5) 

with 

C = esc 2 9 (pf D /p^ D - l) (p° s %/p^ D -i)"'- (6) 

Equation (JSJ shows that ^ > (to guarantee the op- 
eration efficiency 77 < 1). The first factor of £ in Eq. (JüJ) 
is positive, while the second factor, which can be sim- 
plified to exp(— /3l>Ad) — 1, is negative. Thus, we can 
conclude that the third factor of Ç in Eq. © is negative. 
This results in Tg > Tn (A,<? /An) , and it agrees well with 
the positive- work condition |l·llll2l | for a simple quantum 
Otto cycle without Maxwell's demon. This coincidence is 
nontrivial since here T$ and Tu are the temperatures of 
the baths surrounding qubits S and D in the whole c ycle . 

This is different from the temperatures in Refs. mm, 

where the two temperatures are defined by two different 
isochoric steps in thermodynamic cycles. 

Remarks on the QHE cycle and the roles 0/ the quan- 
tum Maxwell's demon. — Let us further understand each 
step in the above QHE operations. We first consider 
the thermalization problems for the two qubits coupled 
to two separated baths, which can be modelled as two 
colleetions of harmònic oscillators with different temper- 
atures, e.g., Ts and Tu- The baths have the average 
thcrmal excitation n(T F ,o; F ) = l/[exp(/3 F a; F ) — 1] in 
the mode with frequeney w F (F — S, D) of the baths. 
After thermalization, the population difference of F can 
be calculated [ï(j as 

(4 F) (t)) - \ (Vf ) (0))M F + l) e-^-{l/M F ) , (7) 

where Mp = 1 + 2rt(T F , A F ) is time-independent. The 
damping rate 7 F of F depends on the specific physi- 
cal realization. When t ^> I/jf, F will approach its 
steady state p F (l) in Eq. with {ai F \t — > oo)) s = 
— 1/Mf- Then, we can obtain the equilibrium distribu- 
tion, p F (l) = (1 — l/M F )/2, of the two-level system, 
usingp F (l) ±p F (0) = (cri F) (í)>( lTl '/ 2 . It is crucial that 

( F) 

the steady term (a z (t —> oo)) s in Eq. 10 is indepen- 
dent of the initial state, since the initial information is 
erased by quantum dissipation, with damping rate 7 F . 
Hence, whatever initial state the total system is (e.g., an 
entangled state), the final steady state of S or D would 
be in its own thermal equilibrium state. 

The CNOT operation in the step S2 can be referred 
to a one-bit quantum pre-measurement on the quantum 



system S by the Maxwell's demon As for the CEV 
in step S3, we noticed that, when we choose i) the CEV 
to be a special case 8 = tt/2, i.e., a CNOT, and ii) the 
temperature T D to be so low that exp(— (3 D A D ) -C 1, 
i.e., the demon is "erased" nearly to its ground state 
PD (1) ~ \0 D ) (Ou I [3, the efficiency of our QHE Eq. © 
becomes rj — 1 — (Ad/ As). This is exactly the efficiency 
of a simple quantum Otto cycle without Maxwell's demon 
[ïfl Ull lï^ l . Otherwise the operation efficiency JHJ) is less 
than the efficiency of a simple quantum Otto cycle. This 
is because i) when Td is vanishingly small, the demon 
can be restored to a zero-entropy "standard state" 0, 
lïflj l to acquire information about the system in the most 
efficient way, and ii) among all CEVs the CNOT is the 
optimum operation to extract work. 

One might ignore the effect of the demon by only con- 
sidering the reduced density matrix ps = Tru [p] of S by 
tracing over the variable of D. After the step S3, one has 
the reduced density matrix ps (3) = Tru[p(3)]. The fol- 
lowing thcrmalization of ps (3) restores <S* into its initial 
equilibrium state ps(l) by absorbing heat. Therefore, 
the net result of ignoring the demon means that there 
exists a perpetual machine of the second kind, which ab- 
sorbs heat from a single heat bath and converts it into 
work. This obvious violation of the second law of thermo- 
dynamics leads to the so-called "Maxwell's demon para- 
dox" . When the demon is included in the thermodynamic 
cycle, however, the "paradox" disappears and the viola- 
tion of the second law is prevented. Hence the present 
concrete model shows the effect of Maxwell's demon and 
verifies the prediction of Landauer's principle. 

Experimental implementation based on superconduct- 
ing systems. — The above Maxwell's demon assisted QHE 
model can be demonstrated by a realistic system, e.g., the 
superconducting quantum circuit illustrated in Fig. 2(a), 
described by the Hamiltonian (JIJ . Here, two qubits S and 
D are specified to two charge qubits || with the control- 
lable level spacings A F = E cF \n gF — 1/2 1 (F = S, D), 
manipulated by the gate voltages V gF , where E cF is the 
effective charging energy and n gF = V gF C gF /2e is the 
offset reduced gate charge of the qubit F. Here, the mag- 
nètic fluxes threading the two qubits are set to <ï>o /2. The 
coupling constant El = Eq cos(7r$ a: /$o) can be tuned to 
zero by the external magnètic flux <fr x through the dc 
SQUID L, where Eo is the Josephson tunnelling energy. 
Therefore, the inter-qubit coupling can be switched on 
and off by the magnètic flux $ x . Below We explain how 
to implement our QHE by using the circuit in Fig. 2(a). 

To implement the step SI in our proposal, we turn 
off the interaction between two qubits by applying the 
magnètic flux Q x = $o/2- The two charge qubits are 
coupled to their own baths, which can be realized by 
two local temperatures T5 and Td- This temperature 
difference can be guaranteed by temperature gradient. 
Thus, with a thermalization time of about 1 ~ 10 ps |l7j . 
two superconducting charge qubits can reach their own 
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FIG. 2: (color online). A Maxwell's demon QHE implemented 
by a superconducting circuit, (a) two charge qubits S and D 
with different localized temperatures function as the work- 
ing substance and the demon, respectively. V gF and C gF are 
the gate voltage and capacitance of qubit F. (b) The quan- 
tum lògic operations (two CNOTs) to simulate the demon 
are realized by four i-SWAP operations together with several 
single-bit operations [ï^l . e.g., [&] x , a O-rotation along the 
x axis. Here O = ±7r/2. The quantum control to implement 
these operations is carried out by the dc SQUID L in (a). 



equilibrium states, described by Eq. (J2J). The population 
of each qubit is described by the steady term of Eq. J7J . 

After two qubits reach their equilibrium states, the 
step S2 starts to implement a CNOT operation with 
the demon being the target qubit, and the working sub- 
stance being the controlling qubit. This CNOT can be 
obtained [13| as follows: First, two single-qubit opera- 
tions, [7r/2]x and [w/2]z, are applied on the system as 
well as one single-qubit operation, [—tt/2]z, on the de- 
mon, here [0] i (i — X, Z) denotes a O-rotation along the 
i axis. Second, we turn on the two-qubit interaction by 
setting $2, = and n g s ~ n g D ~ 1/2. Then, two cou- 
pled qubits evolve in time to = TrK/(AE ü ) (about 1 ~ 10 
ns @) through the Hamiltonian to get an i-SWAP 
operation. Third, turn off the two-qubit interaction, and 
a [n/2]x operation is only applied to the demon. Fourth, 
the two-qubit interaction is turn on again and the two 
qubits evolve to = ttH/(4Eç)). Finally, switch off the two- 
qubit interaction, and a [7r/2]z operation is applied to 
the system. After these steps, a CNOT operation is im- 
plemented on the two qubits by the quantum circuit in 
Fig. [!Ja) and Eq. 10 is obtained. 

We now consider the step S3. In our proposed experi- 
mental setup in Fig.|2Ja), the CEV operation in the step 
S3 is chosen as a CNOT operation, with the demon being 
the controlling qubit, and the working substance being 
the target qubit. This CNOT can be obtained similarly 



4 



as the step S2. In this case, the work done by the QHE 
is maximum, since the demon flips the system from the 
excited state to the ground state |0}g. After the step 
S3, the qubit interaction is switched off by Q> x = $0/2, 
then our QHE starts a new cycle. The two CNOT op- 
erations used in S2 and S3 are schematically shown in 
Fig. 0[b) . The total time for these two operations in the 
charge-qubit circuits is ~ 10 ns, which is much lcss 
than the relaxation time 1 ~ 10 fj,s |l7j . 

In the above quantum circuits, if the temperature Tjj is 
so low that exp(— Pd&d) <C 1, the efhciency 77 in Eq. © 
of our proposed QHE approaches rj = 1 — An/Ag of a 

simple quantum Otto heat engine US El E3 In the 

experimental setup, the parameters usually are of the 
following order of the magnitude [ÏÍj |: E c $ ~ 10~ 23 J, 
\2n gS - 1| ~ IÓ" 2 , T s ~ 10~ 2 K. Hence, exp(-/? s A s ) ~ 
e" 1 . If we choose £ cS ~ £ c d and T D - (Tg/10) ~ 10~ 3 
K, then we certainly have exp(— (3d^d) ~ e -10 <C 1. 
Using the parameters about Ajj and A5 of the super- 
conducting qubits, the efhciency 77 of the QHE can be 
furthcr givcn by 



77 = 1 



\2n gD - 1 



2n 



í/S 



1 



(8) 



which is independent of T5 and Tr>. Here, we have ad- 
justed the macroscopic quantum circuit to be symmetric 
with respect to D and S by choosing E c $ = E c rj. For 
instance, if n g o — 0.498 and n g s = 0.492, the efhciency 
becomes ij = 0.75. 

The derived expression, in Eq. (JSJ, for the QHE efh- 
ciency could be tested by experiments on superconduct- 
ing qubit circuits. There are three important conditions 
for the experimental implementation of our QHE: i) con- 
trollable two-qubit operations; ii) two different temper- 
atures Ts and Tjj for the two nearby qubits; and iii) 
precise measurements of the power of the microwave 
irradiations. The first one has been discussed above. 
The second condition could be achieved by a tempera- 
ture gradient on the chip. For the third condition, a 
precise measurement of the power spectrum of the mi- 
crowave is experimentally accessible in these circuits. 
Hence, the heat Q m absorbed by S and the heat Q ou t 
released by D can be measured, when they are in con- 
tact with their respective baths in the step SI. Similar 
to the arguments in Ref. 0, 0, El E3- tne work pro- 
duced in this cycle depends on the conservation of en- 
ergy W = Q m — Q ou t and does not depend on the spe- 
cihc operation performed. We can also estimate the out- 
put power of the QHE. From Eqs. J^J and (JHJ), we have 
W ~ rjQin ~ 77 Aspg(l) ~ 10~ 25 J, and the time interval 
of a cycle is about r ~ 10 fis. Hence the output power 
becomes P = W/t ~ 10~ 20 J s _1 . We emphasize that 
we are now interested in conceptual designs of new types 
of QHEs, rather than their engineering applications. 

In summary, we have studied the operation of a 
Maxwell's-demon-assisted QHE and justihed the predic- 



tions of Landauer's principle: i) a measurement does not 
necessarily lead to entropy increase 0, 0, @ ; and ii) the 
apparent violation of the second law does not hold when 
the restoration of the demon's memory is included in the 
cycle Q, 0, IS S IE IE ' because under certain condi- 
tions, our composite QHE is equivalent to a simple quan- 
tum Otto engine. We also use superconducting quantum 
circuits as an example showing how to implcmcnt this 
QHE. 
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China. 
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